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DISPLAYING ELECTRONIC CONTENT 

TECHNICAL FIELD 

This invention relates to displaying dimensionalized 
electronic content in three dimensions (3D) on a graphics 
rendering device, such as computer screen, hand-held computing 
device, or television. 

BACKGROUND 

Existing systems provide a user with methods for 
displaying and manipulating dimensionalized electronic 
content. One such system uses time as the primary attribute 
for arranging the content and for providing a two-dimensional 
(2D) timeline representation. In this system, each piece of 
electronic content is placed in its absolute position along a 
timeline. Another existing system provides an electronic 
program guide (EPG) that arranges a listing of scheduled 
television programs in a two-dimensional grid. Each column of 
the grid represents a time slot and each row of the grid 
represents a broadcast or cable program channel. 
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DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of an interactive electronic 
content distribution network. 

Fig. 2 is a flowchart showing a process for creating a 
5 collage of objects representing temporal electronic content. 

Fig. 3a is a top view of a reverse chronological 
straight-on layout arrangement of electronic content. 

Fig. 3b is a perspective view of the reverse 
chronological straight-on layout arrangement of the electronic 
10 content shown in Fig. 3a. 

Fig. 4a is a top view of a chronological staggered layout 
arrangement of electronic content. 

Fig. 4b is a perspective view of the chronological 
staggered layout arrangement of the electronic content shown 
15 in Fig. 4a. 

Figs. 5a to 5d show representations of a collage created 
using the process of Fig. 2. 

Figs. 6 and 7 show actual graphical representations of 
collages created using the process of Fig. 2. 

20 

DESCRIPTION 

Fig. 1 shows an example of an interactive electronic 
content distribution network 100. Network 100 includes 
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multiple graphical user interface (GUI) units 102, each 
configured to display a 3D arrangement of objects representing 
electronic content. The GUI units 102 may take the form of, 
e.g., a desktop computer 102a, personal digital assistant 
(PDA) 102b, laptop computer 102c, set-top box coupled to a 
television set 102d, or television set 102e with an 
incorporated user interface unit. However, the embodiments 
described herein use the desktop computer only. 

A distribution server 104 connected to network 100 
maintains a content distribution database 106 suitable for use 
with electronic content provided by one or more content 
provider databases 108a to 108c. In another embodiment, the 
content database (or databases, as the case may be) resides 
directly on a device 102a to 102e. 

Each entry in content distribution database 106 may 
include a content identifier and content information. The 
content identifier identifies each element of electronic 
content uniquely. The identifier enables distribution server 
104 to locate (e.g., in a content provider database 108a to 
108c) and obtain a copy of the electronic content that 
corresponds to the identifier. 

The content information specified in a database entry 
defines a time value, content type, content category, and 



-3- 



Docket No.: 10559/498001/P11790 

content provider associated with each element of electronic 
content. For example, each database entry may have the 
following format: <identifier = "content identifier"; time = 
"time value"; type = "content type"; category = "content 
5 category"; source = "content provider">. The data is referred 
to as "multi-dimensional" because it has different aspects, 
e.g., time, type, category, source, etc. 

The time value can be represented in any form, for 
example, by decade, year, month, day, hour, or some 
,,,, 10 combination thereof. The content type may include any type of 
* media in which electronic content can be represented. 

m Suitable content types include, but are not limited to, an 

yi image, sound byte, movie clip, and text. The content provider 

% can be a publisher, distributor or Web retailer of online 

►*15 content, such as Billboard.com; a music label, such as 
^ Columbia Records; a studio and production company, such as 

Miramax Films; a television studio, such as Warner Brothers; a 
newspaper publisher, such as The Washington Post Company; or 
alternatively, a user who stores digital photos on a personal 
20 computer. The content provider or an end-user may embed, in 
the electronic content, a category (e.g., birthday, 
anniversary, New Year's) to which the electronic content 
should be classified. For example, a digital photo stored on 
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an end-user's personal computer can be cataloged in the 
content distribution database 106 as: <identifier = "Joe's 5th 
Birthday"; time = "06202001"; type = "image"; category = 
"birthday"; source = "Bob's personal photo album">. 

5 Described herein are a method and apparatus for 

organizing, arranging, displaying, and interacting with the 
multi-dimensional data. One dimension of the data is chosen 
as the primary dimension. The data is divided into some 
number of "slices" along the primary dimension and displayed 

10 within the graphical space allotted for that slice. 

By way of example, time may be selected as the primary 
dimension. In this example, each slice may be graphically 
represented as a translucent sheet upon which a collage of 
items representing temporal data is displayed. The result may 

15 be a static image, movie image, animation, text, audio clip, 
and/or combination thereof. These items may dynamically fade 
in and out and then reappear elsewhere on a slice to give a 
collage a dynamic, animated appearance. 

Fig. 2 shows a process 200, which may be implemented by a 

20 computer program residing on an end-user's computer 102a. In 
process 200, electronic content for a particular time range 
may be dynamically arranged together in a collage representing 
that time slice. A number of these slices may be arranged 
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sequentially within a 3D computer graphics scene (i.e., 
environment), such that the user may navigate back and forth 
through the content's temporal range by navigating through 
these time slices in the 3D computer graphics scene. 
5 In the example described here, time is considered as the 

primary dimension. Other embodiments may use other data 
attributes as the primary dimension. For example, the 
alphabet may be used as the primary dimension, with each slice 
representing a range in an alphabetized list of content items. 

10 Note also, that in the current example, the content items 

are records describing television programming content. 
However, any dataset of records from any database may be used 
instead of, or in addition, to television programming content. 
For example, the content of a real estate database may be 

15 displayed, with a street address, price range, or square 
footage as the primary dimension. 

Parameters 

Process 200 receives (202) control parameters. These 
20 parameters may be pre-stored and provided to the user. 

Alternatively, process 200 may prompt the user for these 
parameters or they may be determined programmatically or 
provided by distribution server 104. 
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A control parameter may specify an initial time range, 
such as 1967 to 1976. Other control parameters may specify 
the units by which to divide the time range into time slices. 
For example, the time range may be divided (204) into time 
5 slices representing a decade, year, month, day, or hour. 
Process 200 may be configured to divide the time range 
automatically, as follows: 



(1) For a time range spanning less than a day, divide 

10 the time range into time slices, each time slice 

representing an hour. 

P (2) For a time range spanning less than a month, divide 

* the time range into time slices, each time slice 

representing a day. 

^15 (3) For a time range spanning less than a year, divide 

'J the time range into time slices, each time slice 

*1 representing a month. 

Zl (4) For a time range spanning less than a decade, 

divide the time range into time slices, each time 
14,20 slice representing a year. 



i Another control parameter (the "layout parameter") is 

* used to select (206) a layout arrangement for arranging the 

time slices and a navigational model for navigating between 
25 the time slices in the 3D graphics scene. This parameter 

determines whether to organize the time slices linearly with 
the user facing them head-on (see Figs. 3a and 3b), staggered 
(see Figs. 4a and 4b), or sideways (not shown). 
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Other parameters identify electronic content from the 
content database to produce a dataset. In the EPG example, 
the control parameters may be used to select content by genre, 
actor, channel, program length, and whether the program is a 
5 repeat broadcast. Information from other devices, such as a 
set-top box, may be used to permit selection or filtering 
based on whether the user has seen the program before. 

Operation 

Process 200 creates (208) a scene within a 3D coordinate 
Q10 space using an arbitrary origin (0,0,0) and three coordinate 
yj axes (x,y, z). By convention, these axes are perpendicularly 

!il arranged in either a "left-handed" configuration, where +x 

points to the right along a horizontal ground plane, +y points 
f straight upward, and +z points toward the user, along the 

~'=15 ground plane. An alternate "right-handed" configuration is 
f\ identical except for the direction of +z, which points away 

from the user, opposite that of the left-handed configuration. 

Descriptions here will assume a left-handed coordinate system. 

The 3D coordinate space of the scene is referred to as the 
20 "global coordinate space". 

A typical 3D computer graphics scene also provides 

information about lights and a virtual camera. Generally, the 

scene defines the number of lights in the scene, their 
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locations in the global coordinate space, their orientations 
(if they are directional lights), and all the other 
information that a 3D computer graphics rendering engine would 
require to produce the scene. 

A virtual camera (not shown) is also assigned a location 
in the global coordinate space, an orientation, and a field of 
vision. The location of the camera in the global coordinate 
space represents the spot from which an "eye" looks at the 
scene. Like a human eye, the camera has an orientation that 
defines the direction in which it looks, as well as a field of 
vision that defines an angle projecting out from this 
viewpoint. Objects that fall within the angle can be seen by 
the camera (and therefore, the end-user) , and those falling 
outside of it cannot. 

Process 200 creates (210) graphical objects, one for each 
time slice in the time range. A graphical object (called a 
"unit form") may constitute a translucent, gridded sheet with 
a text field label that specifies the time slice represented 
by that unit form. As is the case for all graphical objects 
in a typical 3D computer graphics scene, each unit form is 
defined by its own local coordinate space, with an origin 
(0,0,0) at the center of that object. 
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Process 200 arranges (211) the set of unit forms (e.g., 
50 in Fig. 3b) within the global coordinate space of the scene 
based on the layout arrangement parameter described above. 
Assume, for example, that the end-user elected to divide the 
5 10-year time range of 1967 to 1976 into 10 time slices, and to 
arrange the time slices using a reverse chronological 
straight-on layout arrangement. In this case, the unit forms 
are arranged as shown in Figs. 3a and 3b, which are top and 
perspective views, respectively. When placed in reverse 

,^10 chronological order, the time slices are arranged such that 
the unit form of the "1976" time slice has the highest z 

Ijl value, and the unit form of the "1967" time slice has the 

|jf lowest z value. 

s Other layout arrangements include, but are not limited 

r ; *15 to, a side-by-side arrangement (not shown) and a chronological 
2 staggered layout arrangement shown in Figs. 4a and 4b. When 

placed in forward chronological order, the time slices are 
arranged from earliest-to-latest, front-to-back, such that the 
unit form of the "1967" time slice has the highest z value (is 
20 in front) , and the unit form of the "1976" time slice has the 
lowest z value. Figs. 5a to 5d show a front view of a 
staggered layout arrangement with time slices removed starting 
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with 1967 in Fig. 5a, leaving 1976 in Fig. 5d. Other 
arrangements may also be used. 

Process 200 queries content distribution database 106 to 
retrieve (212) records (i.e., content elements) that 
5 correspond to the content parameters. For each such record, 
process 200 creates (214) a 3D computer graphics object 
(called "content particle") that represents the electronic 
content in the scene. In one embodiment, each content 
particle created by process 200 has geometry and surface 
10 attributes, such as color and transparency, and is defined by 

3 

=? its own local (e.g., XY) coordinate space. 

5 := s The actual graphical design of these content particles is 

:1=. subject to artistic interpretation. The content particles may 

F , be constructed as descriptive shapes or icons, as static or 

§415 moving images, or as text. Color-coding may also be used to 
H. indicate various content attributes, such as genre. 

?* Content particles may also include an audible component 

in addition to, or instead of, a graphical component. In one 
embodiment, such particles play audio clips when the virtual 
20 camera comes near them, when the user gestures (e.g., double- 
clicks) for their playback, or by some other programmatic 
means. For example, these particles may play hit songs and 
poignant audio clips (e.g., "That's one small step for a 
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man.. .one giant leap for mankind.") from the year (1969) of that 
time slice as the user browses through the scene. 

Process 200 represents each data record by a "content 
particle" that may be a still or moving picture, graphical 
icon, audio clip, or other design. Process 200 arranges (216) 
the appropriate content particles within each unit form in a 
collage and displays (218) the collage on a GUI. Figs 6 and 7 
show examples of collages displayed by process 200. 

The collages may be dynamically animated such that 
content particles fade in and out. Particles may be animated 
across the unit form. Particles that fade in and out may 
reappear at the previous location or at another location on 
the unit form. A subset of particles may be displayed on the 
unit form at any one time, optionally cycling through the full 
set in either a determined or random manner. 

Other arrangements of content particles are possible, 
including, but not limited to, a 2D array, matrix, clustering, 
grouping, or a combination of technigues. 

The order of events described herein is not specific to 
the invention; embodiments may choose to perform these actions 
in a different order or only in part. For example, one 
embodiment may elect to generate unit forms and particles only 
for a certain range of slices so as not to create graphical 
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objects that are outside the current view, thus reducing the 
resource demands of a computer or reducing the time required 
to generate the display. Other embodiments may elect to 
create these objects, but not to display them unless they are 
5 within the current view. 

Computer animation is performed by a repeated succession 
of moving and then drawing or "rendering" visible objects. 
The mechanics of 3D graphics are well known to one skilled in 
the art, as defined, e.g., by such industry standard 
10 "application programming interfaces" as OpenGL or Open 
»f Inventor™. Process 200 may be implemented using a computer 

^ program written in accordance with these standards . 

% Process 200 can be used to create a user-navigable, 3D 

electronic program guide of television show times. For 
1^15 example, content distribution database 106 may be used to 
••'4 catalog information related to television shows provided by 

H one or more television networks. A user can interact with 

electronic content distribution network 100 using a television 
102e to create a collage of objects representing television 
20 shows occurring, e.g., on Wednesday, August 6, 2001, between 

10am and 3pm. Process 200 can also allow the user to download 
images or details about a television program, scheduled to be 
broadcast during that time, from a remote server. 
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Process 200 is not limited to use with the hardware and 
software of Fig. 1. It may find applicability in any 
computing or processing environment. Process 200 may be 
implemented in hardware, software, or a combination of the 
two. Process 200 may be implemented in computer programs 
executing on programmable computers or other machines that 
each include a processor, a storage medium readable by the 
processor (including volatile and non-volatile memory and/or 
storage components) , at least one input device, and one or 
more output devices. Program code may be applied to data 
entered using an input device (e.g., a mouse or keyboard) to 
perform process 200 and to generate output information. 

Each such program may be implemented in a high level 
procedural or object-oriented programming language to 
communicate with a computer system. However, the programs can 
be implemented in assembly or machine language. The language 
may be a compiled or an interpreted language. 

Each computer program may be stored on an article of 
manufacture, such as a storage medium (e.g., CD-ROM, hard 
disk, or magnetic diskette) , that is readable by a general or 
special purpose programmable computer for configuring and 
operating the computer when the storage medium or device is 
read by the computer to perform process 200. Process 200 may 



-14- 



Docket No.: 10559/M98001/P11790 

be implemented as a machine-readable storage medium, 
configured with a computer program, where, upon execution, 
instructions in the computer program cause a machine to 
operate in accordance with process 200. 
5 It is noted that, in response to a user selection, the 

machine running process 200 makes a corresponding data 
selection. So, any selection operation can be conceived of as 
both a user and a machine selection. It is also noted that 
the term "three-dimensional", as used herein, refers to the 
10 virtual 3D space in the context of a computer graphics 
*j environment, and not to real-life 3D. 

if. The invention is not limited to the embodiments described 

; \ herein. For example, the blocks of Fig. 2 can be performed in 

5. a different order and still achieve desirable results. 

fcM.5 Other embodiments not specifically described herein are 

*"4 also within the scope of the following claims. 

r * What is claimed is: 
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